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Summary.  Piecewise  linear-quadratic  programming  problems  are  a  fundamental  class  of 
optimization  problems  in  the  mathematical  modeling  of  multistage  decision-making  and 
large-scale  dynamical  systems,  with  or  without  the  presence  of  uncertainty.  Patterns  of 
mathematical  structure  in  such  problems  have  been  identified  that  cover  wide  areas  of  ap¬ 
plication  and  are  conducive  to  the  development  of  solution  methodology.  Work  has  gone 
forward  on  utilizing  this  structure  in  new  numerical  procedures,  which  include  “finite- 
envelope  methods"  and  a  “double  conjugate  gradient  method”,  as  well  as  a  simplex-like 
algorithm  for  solving  small-scale  subproblems.  Preliminary  tests  have  been  made  of  these 
precedures  on  problems  of  modest  size.  To  pave  the  way  for  experiments  with  larger  exam¬ 
ples,  program  modules  for  handling  discrete-time  dynamics  have  been  coded  in  part.  For 
decision  problems  involving  scenarios,  a  progressive  hedging  algorithm  has  been  devised. 
This  provides  a  systematic  approach  to  optimization  in  cases  where  uncertainty  cannot  be 
modeled  in  terms  of  standard  random  variables. 
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Research  Directions  and  Motivation. 

Quadratic  programming  problems  have  long  been  recognized  as  fundamental  in  optimiza¬ 
tion,  but  in  the  traditional  formulation  they  suffer  from  serious  drawbacks  that  make  them 
unsuitable  for  large-scale  modeling  of  dynamic  or  stochastic  structure.  While  work  has 
been  done  on  iterative  methods  of  solution  for  quadratic  programming  problems  of  high 
dimension  (as  surveyed  by  Y.Y.  Lin  and  J.-S.  Pang  [l],  J.-S.  Pang  [2]),  the  attitude  has 
mainly  been  one  of  extending  existing  approaches  through  clever  use  of  subproblem  de¬ 
composition,  sparseness  of  coefficient  matrices,  and  efficient  approaches  to  pivoting.  The 
real  difficulty,  however,  is  that  all  such  approaches  emphasize  exact  treatment  of  constraints 
and  aim  ultimately  at  identifying  the  “active’’  constraints  at  the  solution.  In  problems  that 
are  infinite-dimension?!  ber-snce  'mntinuous  time  or  continuous  probability  distributions, 
that  kind  of  thinking  makes  little  sense,  so  it  is  not  surprising  that  quadratic  programming 
approaches  to  the  discretized  versions  of  such  problems,  or  to  problems  that  involve  many 
time  periods  and  possible  events  even  if  there  is  no  continuous  analogue,  have  not  been 
very  successful. 

Piecewise  linear-quadratic  programming,  a  newly  developing  subject  that  has  been  the 
focus  of  this  grant,  starts  from  a  quite  different  point  of  view.  Constraints  that  are  simple 
variable  bounds  or  dynamical  equations  arc  handled  in  a  special  pattern  that  brings  out 
their  primal-dual  potential,  but  other  constraints  are  not  introduced  as  such.  They  are 
replaced  by  “monitoring  terms”,  for  instance  penalty  expressions,  that  allow  for  trade-offs 
between  costs  and  other  factors.  This  tactic  has  the  advantage  of  much  greater  flexibility 
in  computation,  avoiding  the  conceptual  bias  toward  low  dimensions,  but  it  also  requires 
theoretical  innovations  and  a  fresh  start  in  numerical  methodology. 

The  following  papers,  presenting  accomplishments  supported  by  this  grant,  address 
issues  in  this  area  and  lay  a  foundation  for  further  research  now  in  progress  or  anticipated 
in  the  near  future. 

[A]  “Computational  schemes  f  "lving  large-scale  problems  in  extended  linear-quadratic 
programming”,  submitted  •  ■  ’  'ath.  Programming. 

[B]  “A  simplex-active-set  algorithm  for  monotropic  piecewise  quadratic  programming”, 
submitted  to  Math.  Programming  (with  J.  Sun). 

[C]  “Generalized  linear-quadratric  problems  of  deterministic  and  stochastic  optimal  con¬ 
trol  in  discrete  time”,  accepted  for  publication  in  SIAM  J.  Control  Opt.  (with  R.  J-B. 
Wets). 

[D]  “Scenarios  and  policy  aggregation  in  optimization  under  uncertainty”,  submitted  to 
Math,  of  Operations  Research. 

The  results  in  these  papers  will  be  outlined  below.  Besides  addressing  the  nature  of 
piecewise  linear-quadratic  programming  in  general,  they  set  up  tools  for  the  mathematical 
modeling  of  multistage  optimization  problems  subject  to  various  kinds  of  uncertainties. 

On  the  numerical  side,  considerable  effort  has  gone  into  comptational  experiments  with 
new  methods  for  solving  piecewise  linear-quadratic  programming  problems  in  the  kind 
of  format  suitable  for  large-scale  applications.  Code  modules  have  been  programmed  and 
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tested  for  later  incorporation  into  a  "finite  envelope  method”  package  for  the  multistage 
problems  being  modeled.  Another  approach  which  has  been  opened  up  and  looks  very 
promising  is  that  of  primal-dual  conjugate  gradient  schemes  for  such  problems.  Progress 
in  these  directions  will  be  described  too. 

An  overall  aim  of  this  research  is  to  develop  a  better  version  of  linear-quadratic  mod¬ 
eling  for  use  in  optimization,  get  corresponding  new  solution  methods  set  up  for  it,  and 
then  tackle  large  nonquadratic  problems  by  this  means  through  iterative  approximation  in 
terms  of  the  new  generalized  linear-quadratic  subproblems. 

Piecewise  Linear-Quadratic  Programming. 

The  challenge  posed  by  piecewise  linear-quadratic  programming  can  best  be  appreciated 
through  a  brief  comparison  with  ordinary  quadratic  programming,  as  conceived  up  until 
now.  The  latter,  in  the  standard  description,  consists  of  minimizing  a  quadratic  convex 
function  subject  to  a  system  of  constraints  in  the  form  of  linear  equalities  and  inequalities. 
The  constraints  define  a  kind  of  set  that  is  said  to  be  polyhedral.  To  be  specific,  let  us 
write  this  set  in  terms  of  vectors  u  =  (uj , . . .  ,  a*)  in  IRfc  as 

{u  e  U  |  Du  -  q  <  0},  (1) 

where  L  is  a  relatively  simple  subset  of  IR*  such  as  a  box  giving  upper  and  lower  bounds 
on  the  variables,  q  £  IR/  and  D  €  IR/x,t.  The  objective  function  is  given  by  a  expression 

p-u  +  ju-Pu,  (2) 

where  p  is  a  vector  of  coefficients  and  P  is  a  symmetric,  positive  semidefinite  matrix.  The 
ordinary  problem  thus  consists  of  minimizing  the  expression  (2)  over  all  u  belonging  to  the 
set  (1).  When  P  =  0,  one  has  the  case  of  linear  programming. 

This  traditional  view  of  quadratic  programming  suffers  from  serious  limitations.  In 
mathematical  modeling  it  emphasizes  the  introduction  of  exact  constraints  q  —  Du  <  0. 
which  may  well  be  the  wrong  direction  to  take  in  a  large-scale  setting.  The  possibility 
of  modeling  with  penalty  terms  is  ignoied  or,  at  the  least,  shoved  into  the  background. 
Furthermore,  dualization  is  made  inconvenient  or  impossible  in  anything  but  the  most  ele¬ 
mentary  cases.  This  precludes  the  effective  use  of  primal-dual  approaches  to  computation 
such  as  otherwise  might  be  envisioned. 

In  piecewise  linear-quadratic  programming,  as  it  has  emerged  through  this  project,  a 
typical  problem  instead  takes  the  form 

minimize  f(u)  =  p-u  +  \u-Pu  +  p(q  —  Du)  over  u  £  U, 

where  U  is  still  a  relatively  simple,  polyhedral  set,  but  p  is  a  monitoring  function  which 
may,  for  instance,  give  penalties  on  the  difference  between  q  —  Du  and  0  if  this  difference 
is  in  an  undesired  direction.  The  monitoring  function  is  generally  just  piecewise  linear 
quadratic,  i.e.,  given  by  different  linear  or  quadratic  expressions  on  various  polyhedral 


cells,  and  the  objective  function  /  is  therefore  only  piecewise  linear-quadratic  as  well. 
This  is  a  serious  complication,  but  research  under  this  grant  has  shown  that  in  all  of  the 
most  important  cases,  at  least,  /  can  be  given  an  alternative  representation  in  which  an 
underlying  simplicity  is  regained. 

The  representation  involves  a  Lagrangian  function  L(u,v)  on  a  product  set  U  X  V , 
where  V  is  a  polyhedral  set  in  a  space  1R(.  One  has  L(u,  v )  quadratic  in  ( u ,  v),  convex  in 
u  and  concave  in  v\  Thus  in  general 

L(u,  u)  =  pu  +  | u-Pu  +  q-v  —  ^v-Qv  —  v-Du  (3) 

for  symmetric,  positive  semidefinite  matrices  P  and  Q.  One  has 

max  L(u,v)  =  pu  +  \u-Pu  +  pv,o{q  —  Du)  =  f(u )  (4) 

v£V  L 

for  a  certain  monitoring  function  pv'.Q  determined  from  the  specification  of  v'  <md  Q. 
Correspondingly,  one  has 

min L(u,v)  =  q-v  —  \v-Qv  -  pu,p(DTv  -  p)  —  g(v )  (5) 

for  a  certain  monitor,  ng  function  pu,P-  The  primal  problem  thus  takes  the  form 
(V)  minimize  over  u  €  U  the  function  /  in  (4), 

where  /  is  piecewise  linear-quadratic  and  convex,  while  the  dual  problem  takes  the  form 
( Q )  maximize  over  v  €  V  the  function  g  in  (5), 


where  g  is  piecewise  linear-quadratic  and  concave.  Solutions  these  problems  correspond  to 
saddle  points  (u,v)  of  L  relative  to  U  x  V. 

The  formulas  for  the  monitoring  functions  pk,q  and  pc  P  in  (V)  and  ( Q )  can  be  made 
quite  explicit  in  the  context  of  penalty  models  for  constraints,  although  we  shall  forgo  this 
here.  The  main  point  is  that  the  simple  algebraic  character  of  this  class  of  problems  is  not 
to  be  seen  in  terms  of  (V)  and  ( Q )  themselves,  but  in  the  associated  saddle  point  problem. 
A  shift  toward  solution  methods  directed  at  finding  saddle  points  is  thereby  suggested,  in 
contrast  to  the  usual  thinking  devoted  exclusively  to  primal  descent  or  dual  ascent.  It  is 
principally  in  this  direction  that  one  needs  to  turn,  because  the  functions  /(u)  and  g(v) 
are  generally  not  “smooth”  (continuously  differentiable  ^o  whatever  degree  is  desired),  and 
yet.  the  kinds  of  procedures  in  existence  for  nonsmooth  optimization,  such  as  in  the  book 
of  Kiwiel  [3],  are  essentially  conceived  for  low- dimensional  spaces  only. 

Especially  useful  is  the  feature  that  in  being  able  to  calculate  f(u)  for  any  u  €  U  and 
g(v)  for  any  v  €  V,  such  as  points  constructed  in  the  course  of  some  iterative  method  of 
solution,  one  can  obtain  the  difference  e  =  f(u)  —  g(v).  From  basic  duality  theory  it  is 
then  known  that  the  given  u  comes  within  e  of  achieving  the  minimum  in  (V)  while  the 
given  v  comes  within  e  of  achieving  the  maximum  in  (Q).  Thus  progress  can  carefully  be 
measured,  and  a  stopping  criterion  for  suboptimality  is  always  conveniently  at  hand. 
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other  than  u  G  V. 

Double  decomposability  assumption:  For  each  u  G  U  the  maximum  in  v  G  V  can  be 
calculated  in  (4).  Likewise,  for  each  v  G  V  the  minimum  in  u  G  U  can  be  calculated 
in  (5). 

The  finite  monitoring  assumption  means  that  all  constraints  that  might  have  been  forseen 
for  the  vector  q  —  Du  in  [V)  or  the  vector  DTv  —  p  in  (Q)  have  been  modeled  instead 
with  finite  penalties.  It  is  satisfied  if  the  sets  U  and  V  are  bounded,  for  instance,  or  if  the 
matrices  P  and  Q  are  positive  definite.  This  assumption  is  therefore  harmless;  other  cases 
are  readily  approximated  by  it. 

The  double  decomposability  assumption  is  satisfied  in  practice  through  the  fact  that 
L(u ,  u),  as  defined  in  (3),  can  be  taken  to  be  separable  in  u  for  fixed  v  and  also  separable 
in  v  for  fixed  u.  It  is  not  obvious  that  this  is  generally  possible,  and  the  demonstration  that 
it  is  so  is  one  of  the  chief  contributions  of  paper  [C].  The  upshot  is  that  the  minimization  of 
L(u,  v)  in  u  for  fixed  v  reduces  to  a  large  number  of  separate  subproblems  in  the  individual 
components  of  u.  These  subproblems  can  be  solved  in  parallel,  indeed  they  often  are  one- 
dimensional  and  have  closed-form  solutions  that  just  require  plugging  into  a  formula.  This 
holds  as  well  for  the  maximization  of  L(u,v)  in  v  for  fixed  u. 

The  challenge  is  how  to  make  good  use  of  these  advantageous  properties  in  solving  (V) 
and  ( Q ).  The  type  of  thinking  that  is  involved  breaks  with  the  past:  no  one  has  previously 
hit  upon  this  pattern  and  realized  its  fundamental  importance  for  large-scale  applications. 

In  [A]  a  general  foundation  is  built  for  working  with  such  problems,  and  a  class 
of  methods,  called  finite  envelope  methods,  is  introduced  and  analyzed.  These  methods 
proceed  as  follows  in  terms  of  low- dimensional  subproblems.  At  each  iteration  u  (where 
v  =  1,2,...)  a  finite  subset  Uv  of  U  is  designated  along  with  a  finite  subset  Vv  of  V. 
Instead  of  finding  a  saddle  point  of  L(u,v )  over  U  x  V,  one  does  it  over  co  Uv  x  coF", 
thereby  obtaining  a  vector  pair  (u*' ,  v").  This  subproblem  is  small-scale  when  the  number 
of  elements  in  Uv  and  Vu  is  small,  and  it  can  therefore  be  solved  by  small-scale  methods 
of  piecewise  linear-quadratic  programming  like  those  discussed  above. 

At  first  this  assertion  may  seem  surprising,  because  co Uu  and  coV"  nevertheless  lie 
in  spaces  of  putatively  high  dimension,  but  the  reduction  is  made  possible  by  the  quadratic 
structure  of  the  Lagrangian  L.  Elements  of  co  Uv  and  co  V"  can  be  expressed  as  convex 
combinations  of  the  elements  of  Uu  and  Vv ,  the  coefficients  being  nonnegative  and  adding 
up  to  1,  and  when  these  expressions  are  substituted  into  the  formula  for  L{u,v)  they 
result  in  a  low- dimensional  quadratic  form  in  the  coefficients  in  question.  The  subproblem 
thus  reduces  to  one  of  finding  a  saddle  point  of  a  low-dimensional  “projected”  Lagrangian 
function  over  a  product  of  two  simplexes,  and  this  does  belong  to  the  realm  of  small-scale 
piecewise  linear- quadratic  programming. 

Results  presented  in  [A]  give  guidelines  for  generating  the  sets  Uv  and  V1,  out  of 
deco  nposed  maximization  in  (4)  or  minimzation  in  (5)  in  such  a  way  that  the  sequence 
of  pairs  [uu ,vv)  calculated  from  the  subproblems,  or  another  easily  derived  from  it,  will 
converge  to  a  saddle  point  (u,v)  of  L(u,  y)  on  U  xV  and  thus  provide  an  optimal  solution 
u  to  (V)  and  an  optimal  solution  v  to  (2).  Remarkably,  it  is  not  necessary  for  the  number 
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of  elements  in  Uv  and  Vu  to  grow  indefinitely  in  order  to  ensure  this  convergence.  As 
long  as  the  matrices  P  and  Q  are  positive  definite,  convergence  to  optimality  can  be 
guaranteed  with  these  sets  kept  really  small.  Of  course  this  is  a  theoretical  fact,  which 
must  be  supplemented  by  numerical  experience  as  to  the  rules  that  seem  to  work  best.  The 
positive  definiteness  supporting  the  convergence  can  always  be  introduced  if  necessary  by 
an  outer  algorithm  of  the  proximal  point  variety,  first  developed  by  the  P.I.  in  [71,  [8]. 

In  the  numerical  experiments  on  finite  envelope  methods  that  have  been  carried  out 
so  far,  the  dimensions  of  the  u  and  v  vectors  have  been  kept  at  about  50  each.  This  size, 
which  does  not  correspond  to  ultimate  large-scale  aims,  has  been  dictated  by  a  number  of 
factors,  the  most  important  being  that  of  getting  ahead  with  initial  tests  of  ideas  while  the 
way  was  being  prepared  on  a  separate  track  for  utilizing  more  details  of  structure,  such  as 
are  sure  to  be  present  in  dynamic  or  stochastic  versions  of  (V)  and  (Q).  To  a  good  job 
of  experimenting  with  large  problems,  it  is  not  appropriate  merely  to  generate  bigger  and 
bigger  matrices  randomly.  Steve  Wright,  a  Ph.D.  student  in  the  Mathematics  Department 
of  the  University  of  Washington  who  has  received  support  as  an  R.A.  under  this  grant,  has 
been  developing  code  to  make  large,  but  sensible  and  well  chosen  problems  available  for 
numerical  testing.  This  will  be  described  below  in  connection  with  the  modeling  efforts. 

Anyway,  with  the  50  x  50  problems  the  method  has  worked  well  and  much  has  been 
learned  about  different  strategies  in  implementation.  This  experience  has  been  invaluable 
in  setting  the  stage  for  the  next  level  of  computation.  It  has  also  been  possible  to  draw 
on  experience  with  an  earlier  version  of  finite  envelope  methods  in  the  case  of  two-stage 
stochastic  programming  as  developed  in  Rockafellar  and  Wets  [9],  [10],  and  implemented 
by  King  [11]  and  Wagner  [12].  That  version  concerned  cases  where  only  the  v  dimension 
is  high,  so  the  subproblems  consist  of  finding  saddle  points  over  sets  U  x  coK",  i.e.,  one 
can  work  directly  at  all  times  with  the  whole  set  U .  Incidentally,  the  proximal  point  outer 
algorithm  mentioned  above  was  used  in  this  case  to  great  effect. 

Another  line  of  attack  on  large-scale  piecewise  linear-quadratic  programming  problems 
under  the  finite  monitoring  and  double  decomposibility  assumptions  has  been  a  new  “dou¬ 
ble”  form  of  the  conjugate  gradient  method.  The  conjugate  gradient  method  is  well  known 
in  numerical  optimization  as  a  means  of  minimizing  an  unconstrained  quadratic  convex 
function  in  finitely  many  steps  and,  in  various  generalizations,  providing  a  good  iterative 
approach  to  minimizing  a  smooth  (twice  continuously  differentiable)  convex  function  on  a 
space  of  high  dimensions.  For  problems  with  constraints,  however,  the  classical  method 
has  been  hampered  by  development  only  in  terms  of  active  constraint  strategies  which,  as 
already  pointed  out,  are  unsuitable  for  large-scale  applications. 

The  new  version  of  the  conjugate  gradient  method  now  under  development,  the  work 
on  it  having  been  started  in  the  grant  period  covered  by  this  report,  makes  use  of  the 
assumed  ability  to  calculate  vectors  giving  the  maximum  in  (4)  or  the  minimum  in  (5)  and 
interprets  this  operation  as  a  sort,  of  gradient  projection  onto  the  sets  U  and  V.  Certain 
formulas  that  are  well  known  classically  can  then  be  emulated  despite  the  constraints  u  £  U 
and  v  £  V  to  get  a  procedure  resembling  the  conjugate  gradient  method  for  minimizing 
f(u)  over  U  in  the  primal  problem  (V)  as  well  as  one  for  maximizing  g(v )  in  the  dual 
problem  (2)-  The  truly  novel  feature — with  surprising  consequences — is  that  both  the 
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primal  and  dual  methods  are  executed  simultaneously  and  with  a  kind  of  feedback. 

The  feedback  comes  from  the  circumstance  that  each  of  the  conjugate  gradient  algo¬ 
rithms,  although  applied  in  concept  to  only  one  of  the  two  problems,  inevitably  produces 
information  about  the  other  problem.  By  running  them  simultaneously  and  letting  them 
"listen  to  each  other”,  it  is  possible  to  take  advantage  of  this  information  to  keep  either 
algorithm  from  getting  into  a  rut.  Numerous  restarts  occur,  namely  when  one  of  the  algo¬ 
rithms  latches  on  to  a  better  point  that  happens  to  have  been  produced  by  the  companion 
algorithm,  and  such  events  usually  result  in  drastic  improvements  in  the  move  toward  op¬ 
timality. 

A  major  share  of  the  effort  on  this  conjugate  gradient  phase  of  the  project  has  been 
put  in  by  Ciyou  Zhu,  a  Ph.D.  student  in  the  Applied  Mathematics  Department  of  the 
University  of  Washington.  He  was  not  able  to  receive  R.A.  support  from  this  grant, 
however,  due  to  a  lack  of  funds.  (He  was  supported  from  other  sources.) 

The  double  conjugate  gradient  method  may  supersede  the  finite  envelope  class  of 
methods,  as  it  has  given  better  performance  in  tests  so  far.  It  has  even  been  used  tried 
with  success  on  problems  of  size  500  x  500.  The  real  tests,  though,  will  come  when  the 
very  large,  structured  problems  come  on  line.  Those  problems  may  balk  at  the  line  search 
routine  required  in  the  conjugate  gradient  approach  and  may  need  more  accumulation  of 
information,  such  as  can  be  accomplished  through  the  many  ways  of  generating  envelopes 
in  the  choice  of  the  sets  U"  and  V". 

Large-Scale  Modeling. 

A  strong  motivation  for  studying  problems  in  piecewise  linear-quadratic  programming  has 
been  the  fact  that  such  problems  provide  an  apparently  effective,  but  heretofore  unrecog¬ 
nized,  way  to  capture  the  large-scale  optimization  structure  in  a  wide  class  of  applications. 
This  has  been  brought  out  quite  strikingly  in  paper  [C],  written  jointly  with  R.  Wets  of 
the  Depart— ~r*-  of  Mad  hematics  of  *-he  University  of  California  at  Davis.  Earlier  work 
with  Wets  in  [9]  had  shown  that  two-stage  stochastic  recourse  problems  with  underlying 
linear-quadratic  structure  could  advantageously  be  placed  in  this  format,  thereby  opening 
new  avenues  of  insight  and  computation.  The  P.I.  had  also  demonstrated  more  recently  in 
[13]  that  optimal  control  problems  in  continuous  time  could  be  viewed  in  terms  of  a  sort  of 
infinite-dimensional  piecewise  linear-quadratic  programming,  and  1T1  *h;s  manner  it  is  pos¬ 
sible  to  look  numerically  at  constrained  forms  of  linear-quadratic  control,  including  some 
with  nonquadratic  classical  penalties,  that  previously  had  been  beyond  the  pale.  In  [C], 
however,  the  problems  can  be  multistage  stochastic  as  well  as  deterministic.  The  context 
is  one  of  discrete  time  and  discrete  probability.  Substantial  results  are  obtained  about  the 
characterization  of  optimality,  and  entirely  new  territory  is  entered  for  setting  up  problem 
models  advantageously. 

It  is  difficult  here  to  do  justice  to  the  full  scope  and  potential  in  [C],  but  a  particular 
case  will  convey  the  key  ideas.  For  now,  the  description  will  be  deterministic  only,  but  the 
stochastic  version  will  come  up  later. 

The  primal  problem  to  be  discussed  concerns  a  dynamical  system  with  states  xt  €  IRJ* 
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and  controls  ut  <E  IR*  for  t  =  0.  1 . r,  the  states  being  determined  from  the  controls  by 

.r,  =  A t-i't-i  +  Btut  +  ht  for  t  —  1 . r, 

( G ) 

To  =  BoUo  4-  /)(>.  with  ut  t  it. 

where  the  constraint  set  Ut  is  polyhedral.  As  explained  in  [Cj.  the  introduction  of  the  state 
vectors  is  to  some  extent  an  artificial  construct,  depending  on  the  particular  situation,  but 
it  pays  handsomely  in  bringing  out  the  temporal  structure  without  incurring  any  loss  of 
generality.  The  optimization  problem  for  this  system  is 

r 

minimize  t  +  j' ifPt’it  +  ( flt  ~  C,.  r,_, 

(Vo)  <=1r  .  „  ,  f 

+  -f  -n0  -Po"o|  +  [p\ r+  ( .t'r+ 1  (  rlr  + 1 

subject  to  (G). 

The  monitoring  terms  in  this  problem  (  P())  offer  rich  possibilities  for  specialization,  which 
cannot  be  gone  into  here,  but  the  reseinblence  with  the  earlier  model  problem  (V)  is 
evident. 

What  is  far  from  evident  is  that  (P0)  is  truly  a  problem  of  type  (V)  for  a  certain 
choice  of  data  elements.  It  is  the  primal  problem  corresponding  to  a  Lagrangian  of  the 
form 

r 

Lq(u,v)  =  [pt'nt  4-  \ufPtut  +  fjfi't  —  2  * -t  Qt>'t  ~  I'fDiUt ]  +  l(u.v) 

over  V  x  V  =  (U0  x  •  •  x  Ur)  x  (Vj  x  •  •  •  x  Yr+\ ). 

where  u  =  (uo, .  • . ,  uT)  and  t>  -  (u,, . . . ,  vT+i )  and  the  function  l(u.  v)  is  a  simple  bilinear 
form  expressing  the  dynamics.  The  corresponding  dual  problem  ( Qo )  turns  out  to  have  the 
same  character  as  (Vo)  but  in  terms  of  the  vectors  vt  as  controls  as  well  as  certain  vectors  y, 
as  states  that  are  determined  by  a  dynamical  system  that  goes  backward  in  time  from  r  +  I. 

The  crucial  observation  is  that  the  Lagrangian  Lo(u.v)  has  a  vaiural  double,  de.com- 
po3abihty  with  respect  to  time.  If  v  is  fixed,  the  minimization  of  Lq(u.v)  in  u  breaks  up 
into  separate  problems  for  each  t,  which  in  turn  could  reduce  smaller  problems,  even  one¬ 
dimensional  problems,  if  the  matrices  Pt  and  Qt  are  diagonal  and  the  pe’yhedral  sets  Ut 
and  Vt  are  boxes.  Similarly,  the  maximization  of  Lq(u,v)  in  v  decomposes  relative  to  t. 
This  fundamental  property  had  not  beer  recognized  prior  to  paper  [C]  and  the  continuous¬ 
time  version  in  [13]. 

The  details  of  these  problems  must  be  omitted,  but  the  connection  with  the  preceding 
discussion  of  computational  projects  is  that  it  makes  great  sense  to  aim  in  this  direction  for 
the  testing  out  of  algorithms.  Accordingly,  the  task  was  formulated  of  developing  code  for 
inputing  the  data  that  defines  (Vo)  and  setting  up  program  modules  for  carrying  out  the 
operations  of  minimizing  or  maximizing  Lq(u ,  v)  in  its  separate  arguments  and  integrating 
the  primal  and  dual  state  trajectories  x  and  y  from  the  primal  and  dual  controls. 


—  DtUt)  —  C(4- 1  I  (] 

-  Cr  +  i-r-  )  -  Cr  +  r.r, ] 


This  project  was  taken  on  hv  Steve  Wright,  already  mentioned  as  the  Ph.D.  student, 
who  received  the  budgeted  0  months  of  R.A.  support  under  th<’  grant.  (Another  of  the 
P  i  's  Ph.P  •. indents,  Maijan  Qian  in  the  Mathematics  Department,  got  one  month  for 
her  as-  1  ••’mice  when  it  turned  out  toward  t lie  end  of  the  grant  period  that  the  funds  could 
be  put  together  from  remnants  in  other  categories  of  the  expiring  budget.)  Wright  hits 
programmed  a  fairly  complete  package  based  on  discretizing  a  continuous-time  problem; 
it  has  the  feature  that  simply  by  setting  a  single  parameter  one  can  generate  piecewise 
linear-quadratic  optimization  problems  of  arbitrarily  large  dimension  which  still  have  a 
natural  structure  and  are  therefore  good  for  numerical  testing  of  finite  envelope  methods 
and  the  double  conjugate  gradient  method.  As  of  the  end  of  the  grant  period,  the  manual 
for  this  package  was  being  written  and  the  code,  though  in  principle  complete,  was  still 
being  checked  out. 

Problems  Involving  Uncertainty. 

Tin'  dynamical  problem  (  Pq  )  extends  readily  to  the  treatment  of  stochastic  elements,  i.e.. 
random  variables,  to  which  the  decisions  being  made  can  respond  in  time  as  more  is  learned. 
The  theory  for  this  is  developed  in  paper  [C’j.  A  fundamental  model  for  multistage  stochastic 
programming  is  thereby  obtained,  where  until  now  two-stage  problems  are  virtually  the 
only  ones  that  have  been  approached  computationally.  Trying  to  solve  such  problems 
would  be  premature  at  present,  because  the  multistage  deterministic  framework  needs  to 
be  worked  with  first,  and  that  is  just  coming  on  line.  But  an  ultimate  goal  obviously  is  to 
combine  the  deterministic  methodology  with  that  already  known  from  two-stage  stochastic 
programming  (for  instance  in  [9]  and  [10]).  This  will  forge  a  very  strong  instrument  for 
progress  in  large-scale  optimization  in  a  multitude  of  applications,  from  optimal  control  to 
decision-making  under  uncertainty. 

Paper  [D],  written  under  this  grant  with  the  collaboration  of  R.  Wets,  operates  from 
a  somewhat  different  angle.  It  too  treats  optimization  problems  involving  uncertainty, 
but  the  focus  is  on  the  kind  of  uncertainty  that  is  difficult  to  model  probabilistically,  i.e., 
in  terms  of  random  variables  with  specified  distributions.  Such  problems  are  extremely 
common  but  have  long  stymied  theoreticians.  Typically  they  have  been  approached  by 
means  of  scenarios.  In  this  vein  one  makes  assumptions  about  what  might  happen  in 
the  future  and  identifies  the  optimal  decisions  that  would  be  taken  if  one  were  able  to 
act  validly  on  the  basis  of  such  assumptions.  Each  set  of  assumptions  generates  one 
scenario,  and  typically  some  dozens  are  worked  out  in  a  given  case.  The  challenge  then 
is  to  make  use  of  what  has  been  learned  from  the  separate  scenarios  and  come  up  with  a 
mixed  decision  that  properly  hedges  against  the  eventualities. 

This  “mixing"  has  actually  been  no  more  than  intuitive  guesswork  in  practice,  com¬ 
pletely  devoid  of  theoretical  basis.  In  [D],  however,  a  more  solid  procedure  is  offered.  Ob¬ 
viously  the  topic  does  not  lend  itself  to  really  precise  study,  but  the  supposition  can  be 
made  that  the  decision-maker  does  have  some  notion  of  weights  for  the  different  scenar¬ 
ios.  One  can  search  for  a  sensible,  systematic  approach  to  using  such  weights — from  which 
it  might  also  be  revealed  how  sensitive  the  resulting  mixed  decision  is  to  the  particular 
weights,  thereby  providing  feedback  to  the  decision-maker  and  directing  his  attention  to 
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potential  troublcspots.  This  is  the  motivation  in  [D],  which  presents  an  iterative  method 
for  utilizing  such  weights  in  progressive  hedging. 

A  highly  attractive  feature  of  the  method  is  that  it  builds  on  whatever  method  may 
already  be  available  in  a  given  case  for  solving  an  individual  scenario  subproblem  Modified 
forms  of  such  scenario  subproblems  are  solved  repeatedly  and  in  parallel.  The  outputs 
are  combined  according  to  a  scheme  that  at  any  stage  does  give  at  least  an  implementabh 
policy,  with  the  assurance  that,  as  the  iterations  go  on.  this  policy  will  come  closer  and  closer 
to  satisfying  all  other  requirements  and  being  optimal  (relative  to  the  specified  weights). 

There  is  much  yet  to  be  done  in  this  ongoing  research.  A  number  of  prospects  are 
emerging  for  integrating  the  scenario  ideas  with  the  multistage  optimization  models  dis¬ 
cussed  earlier  to  obtain  a  highly  flexible  methodology. 
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